Papers with modeling approach
A Visuospatial Dataset for Naturalistic Verb Learning (2020.starsem-1)
Copied to clipboard
| Challenge: | a new dataset is available for training and evaluating grounded language models . our data is designed to emulate the quality of language data a pre-verbal child would have access to . |
| Approach: | They propose a dataset for training and evaluating grounded language models . they use naturalistic, spontaneous speech paired with richly grounded visuospatial context . |
| Outcome: | The proposed dataset compares two distributional semantics models with one that does not. |
Temporal Cognitive Tree: A Hierarchical Modeling Approach for Event Temporal Relation Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies focus on locating relative position of event pairs on timeline . hierarchical modeling approach neglects multidimensional information in temporal relation and hierarchy of reasoning. |
| Approach: | They propose a novel hierarchical modeling approach that mimics human logical reasoning by introducing a Temporal Cognitive Tree. |
| Outcome: | The proposed model outperforms existing methods on TB-Dense and MATRES datasets. |
Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification (2022.emnlp-industry)
Copied to clipboard
Jai Gupta, Yi Tay, Chaitanya Kamath, Vinh Tran, Donald Metzler, Shailesh Bavadekar, Mimi Sun, Evgeniy Gabrilovich
| Challenge: | a new method for classification of COVID-19 vaccination related search queries is proposed . the proposed method uses pretrained Transformers and dense features to generate search insights . |
| Approach: | They propose a machine learning model that detects COVID-19 vaccination related search queries . they use pretrained Transformers to consider dense features as memory tokens that the model can attend to . |
| Outcome: | The proposed model improves the Vaccine Search Insights task by +15% . the proposed model uses pretrained Transformers and traditional dense features . |
Incorporating Multimodal Information in Open-Domain Web Keyphrase Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain Keyphrase extraction (KPE) is a fundamental yet complex NLP task . effective designs encode within layout and formatting signals that point to where the important information can be found. |
| Approach: | They propose a multi-modal approach to open-domain keyphrase extraction (KPE) on the Web that leverages layout and formatting signals to aid in the task. |
| Outcome: | The proposed model outperforms state-of-the-art models on the open-domain keyphrase extraction task. |
Conversational Machine Comprehension: a Literature Review (2020.coling-main)
Copied to clipboard
| Challenge: | Conversational machine comprehension (CMC) is a research track in conversational AI. |
| Approach: | They propose to synthesize a generic framework for CMC models and highlight differences in recent approaches. |
| Outcome: | The proposed model will be used as a compendium for future research. |
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in NLP focus on large annotated training data. |
| Approach: | They propose an unsupervised framework that does not use parallel or pseudo-parallel/back-translated data. |
| Outcome: | The proposed framework does not use parallel or pseudo-parallel/back-translated data. |
A Novel Computational Modeling Foundation for Automatic Coherence Assessment (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing models for text coherence assessment rely on a proxy task . however, this approach does not capture the full range of factors contributing to coherency. |
| Approach: | They propose a formal linguistic definition of what makes a discourse coherent and formalize these conditions as respective computational tasks that are jointly trained. |
| Outcome: | The proposed model improves on two human-rated coherence benchmarks. |
DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition (2024.lrec-main)
Copied to clipboard
| Challenge: | End-to-end automatic speech recognition systems suffer from mistranscription of domain-specific phrases, such as named entities. |
| Approach: | They propose a named entity correction model that leverages phonetic con-fusion to mitigate phonetic confusion. |
| Outcome: | The proposed model outperforms the existing model on AISHELL-1 and Homophone datasets. |
Generative or Discriminative? Revisiting Text Classification in the Era of Transformers (2025.emnlp-main)
Copied to clipboard
Siva Rajesh Kasa, Karan Gupta, Sumegh Roychowdhury, Ashutosh Kumar, Yaswanth Biruduraju, Santhosh Kumar Kasa, Pattisapu Nikhil Priyatam, Arindam Bhattacharya, Shailendra Agarwal, Vijay Huddar
| Challenge: | generative classifiers exhibit lower sample complexity but higher asymptotic error in simple linear settings, a trade-off that remains unexplored in the transformer era. |
| Approach: | They propose to evaluate generative and discriminative architectures for text classification using a generative model that learns the conditional probability distribution P (y|x) generative models are known to work better in low-data settings, giving rise to the classical 'two regimes' phenomenon for classification. |
| Outcome: | The proposed models show that the classical 'two regimes' manifests distinctly across different architectures and training paradigms. |
MedFilter: Improving Extraction of Task-relevant Utterances through Integration of Discourse Structure and Ontological Knowledge (2020.emnlp-main)
Copied to clipboard
| Challenge: | Identifying task-relevant utterances improves performance at downstream medical processing. |
| Approach: | They propose a novel approach that uses task-oriented conversations to improve utterance classification over SOTA models. |
| Outcome: | The proposed model improves on a corpus of 7,000 doctor-patient conversations on 7,000 patient conversations. |
Energy Considerations of Large Language Model Inference and Efficiency Optimizations (2025.acl-long)
Copied to clipboard
| Challenge: | Prior benchmarking efforts focused on latency reduction in idealized settings, often overlooking real-world inference workloads that shape energy use. |
| Approach: | They propose a modeling approach that approximates real-world LLM workflows . they show that the effectiveness of inference optimizations is sensitive to workload geometry . |
| Outcome: | The proposed approach reduces energy use by 73% from unoptimized baselines. |